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(54) A method for preserving image detail when adjusting the contrast of a digital image 



(57) A method for preserving detail when adjusting 
tone scale of a digital image channel, the method com- 
prises receiving a digital image channel; providing a 
tone scale function for adjusting the tone scale of the 
digital image channel; spatial filtering the digital image 
with a spatial fiKer which varies with location in the dig- 
ital image channel according to the control signal pro- 



ducing a space-variant spatial filtered version of the 
digital image channel; using the tone scale function and 
the space-variant spatial filtered version of the digital 
image channel to produce an enhanced digital image 
channel. 
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Description 

HELD OF THE INVENTION 

5 [0001] The invention relates generally to the field of digital image processing and, more particularly, to a method for 
preserving image detail when adjusting the contrast of a digital image. 

BACKGROUND OF THE INVENTION 

10 [0002] Existing methods for applying tone scales to digital color images include applying the tone scale to each of the 
color channels independently, applying the tone scale to the neutral channel and preserving the original pixel color dif- 
ference signal, or applying the tone scale to just the low frequency image. These methods of tone scale application alter 
the sharpness and appearance of the color in processed images, and the latter can produce displeasing artifacts. 
[0003] Traditional methods of applying a tone scale function to a digital color image modify the apparent sharpness 

15 of the image because the tone scale modifies the amplitudes of high frequency detail information. This phenomenon 
occurs when the tone scale function is applied to each of the color channels independently, or when the tone scale func- 
tion is applied to the neutral channel and original pixel color difference signals are preserved. 

[0004] In an effort to apply a tone scale function to a digital image without distorting the detail information, in U.S. 
Patent No. 5,012,333 Lee et al. proposed separating the image into a high frequency and a low frequency image by 
20 using FIR filters. The tone scale function is then applied to only the low frequency image, and the high frequency image 
is added back to the tone scaled low frequency image. 

[0005] Also, in U.S. Patent no. 5,454,044 Nakajima suggests modifying the image contrast by the formula 

Sproc = Sorg+f{Sus). 

25 

The low frequency image (Sus) is passed through function f() which is a monotonically decreasing function. This signal 
is added to the original (Sorg) to create the processed image Sproc. 

[0006] Both of these methods preserve the high frequencies of the image, but this may lead to the creation of unsharp 
mask type artifacts (overshoot and undershoot) in the neighborhood of large edges (characteristic of occlusion bound- 
30 aries or dark shadows). 

[0007] Consequently, a need exists for overcoming the above-described drawbacks. More specifically, a need exists 
for permitting the application of a tone scale function to a digital image to adjust the macro contrast of the image, pre- 
serves the high frequency detail information, and prevents artifacts in the neighborhood of large edges. 

35 SUMMARY OF THE INVENTION 

[0008] The present invention is directed to overcoming one or more of the problems set forth above. Briefly summa- 
rized, according to one aspect of the present invention, the invention resides in a method for adjusting tone scale of a 
digital image channel, the method comprising: (a) receiving a digital image channel: (b) providing a tone scale function 
io for adjusting the tone scale of the digital image channel; (c) spatial filtering the digital image with a spatial filter which 
varies with location in the digital image channel according to the control signal producing a space-variant spatial filtered 
version of the digital image channel; (d) using the tone scale function and the space-variant spatial filtered version of 
the digital image channel to produce an enhanced digital in^ge channel. 

[0009] These and other aspects, objects, features and advantages of the present invention will be more clearly under- 
45 stood and appreciated from a review of the following detailed description of the preferred embodiments and appended 
claims, and by reference to the accompanying drawings. 

ADVANTAGEOUS EFFECT OF THE INVENTION 

50 [001 0] The present invention has the advantage of preserving edge detail while altering the contrast of a digital image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] 

55 

Rg. 1 is a block diagram illustrating an overview of the present invention; 

Fig. 2 is an exploded view of the pedestal splitter of Fig. 1 ; 

Rg. 3 is an exploded view of the avoidance signal generator of Fig. 2; 
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Fig. 4 is the artifact avoidance LUT; 

Fig. 5 is an example of a typical tone scale function; and 

Fig. 6 is an alternative embNodiment of tfie present invention. 

5 DETAILED DESCRIPTION OF THE INVENTION 

[001 2] In the following description, the present invention will be desaibed in the preferred embodiment as a software 
program. Those skilled in the art will readily recognize that the equrvalerrt of such software may also be constructed in 
hardware. 

10 [0013] Referring to Fig. 1 , th^-e is illustrated an overview of the present invention. It is Instructive to note that the 
present invention utilizes a digital image which is typically a two-dimensional array of red. green, and tAue pixel values, 
or a single monochrome pixel value corresponding to light intensities, in this regard, a cfigital representation of an 
image, typically in RGB color space consisting of separate red, green, and blue image channels, is transformed to a 
luminance-chronr^nance color space by a color space matrix transformation resulting in a luminance image channel and 

15 two chrominance image channels. It facilitates understanding to note that the present invention operates on only the 
luminance channel or individually on each chrominance channel, for example red, green and blue. This transformation 
into a luminance-chrominance is well known in the art. After the present invention performs its operations, the digital 
image is preferat^y transformed t>ack into RGB color space by an inverse color space matrix transformation for permit- 
ting prirning a hardcopy or displaying on an output device. 

20 [0014] The digital representation of the digital image channel is then divided two portions by a pedestal splitter 20 — 
a pedestal signal and a texture signal, as will be described in detail below. A tone scale function is applied to the ped- 
estal signal by a tone scale applicator 30 in order to change the characteristics of the image for image enhancement. 
The tone scale function way be applied for the purposes of altering the relative brightness or contrast of the digital 
image. A tone scale applicator 30 is implemented by application of a look up table (LUT) to an input signal, as is well 

25 known in the art. An example tone scale showing a 1 to 1 mapping of input values to output values is illustrated in Fig. 
5. The texture signal may be amplified by the texture modifier 40 if desired, or altered in some other manner as those 
skilled in the art may desire. This texture modifier 40 may be a multiplication of the texture signal by a scaler constant. 
The modified texture signal and the modified pedestal signal are then summed together by an adder 50, forming a 
transformed image channel. The addition of two signals by an adder 50 is well known in the art, and will not be further 

30 discussed. 

[0015] Referring to Fig. 2, the digital image channel input into the pedestal splitter 20 is split into a high pass signal 
and a low pass signal by spatial filtering procedure 70 preferatDly with a Gaussian filter with a starxjard deviation (sigma) 
of 2.5 pixels. The preferred value of the standard deviation of the Gaussian filter may vary with image size. The value 
of 2.5 pixels for the sigma value was derived by optimizing the present invention with 1024 by 1536 pixel size images. 
35 This Gaussian filter is a two dimensional circularly symmetric low-pass filter whose filter coefficients may be derived by 
the following formula which is well known in the art: 

G(i.j) = 1/(sigma sqrt(27c)) exp[-(i ^)/(2 sigma ^)] 

40 Where 

G(i,j) = the Gaussian filter coefficierrt at the (l,j) ^ pixel 
Sigma = the standard deviation of the Gaussian filter (2.5) 
n = the constant approximately 3.1415... 

45 

The low-pass signal is input irrto an avoidance signal generator 80 for forming an avoidance signal, as will be descrit>ed 
in detail below. A texture signal generator 90 receives both the high pass signal and the avoidance signal and both sig- 
nals are multiplied therein for producing a texture signal. 

[001 6] The pedestal generator 1 00 receives the original luminance signal and the texture signal and subtracts the tex- 

50 ture signal from the luminance signal, which produces a pedestal signal. 

[001 7] Referring to Fig. 3. there is illustrated an exploded bJock diagram of the avoidance signal generator 80. In this 
regard, the low pass signal is input into a non-directional squared gradient calculator 1 10 for producing a non-directional 
gradient signal. This calculation Is performed by first calculating the difference between the pixel and its upper vertical 
neighlx)r, as well as the difference between the pixel and its horizontal neighkjor to the right. The non-directional 

55 squared gradient is the sum of the squares of th^e two differences. The non-directional squared gradient signal is then 
mapped by an artifact avoidance function applicator 120 to produce an artifact avoidance signal as the output of the 
avoidance signal generator 80. This output signal of the avoidance signal generator 80 will from now on be referred to 
as a(x). 
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[0018] Referring to Fig. 4. this mapping function is performed by passing the non-directtonal squared gradient signal, 
ndg(x). through an artifact avoidance function avQ formed in the following manner. The preferred enrtoodiment of the 
present invention utilizes an artifact avoidance function defined by: 

5 av(y) = (1^) (1 + C0S(7c (y - Co) /(C ^ - Co)) 

fory > Coartdy <Ci, 

av(y) = 0 

10 

for y >= C-i and 

av(y) = 1 

15 for y <= Co where Co and are numerical constants. 

[0019] The preferred values for Co and 0^ will vary according to the range of the input data. The Input data range in 
the images used in the development of this preferred embodiment ranged from 0 to 4095. In this case, the preferred 
value for Co is 148, and the preferred value for C^ is 1300. As an alternate method for constructing the artifact avoid- 
ance function is described in the following equation: 

av(y) = 1 - sqrt( (y - Co) / (C T Co)) 

av(y)=1-.((y-Co)/(Ci-Co)) 

25 for y >= Co and y <= Ci , 

av(y) = 1 

for y < Co, and 

30 

av(y) = 0 

fory >Ci. 

[0020] The artifact avoidance signal. a(x), is generated by the artifact avoidance function applicator 120. This is 
?5 accomplished by applying the artifact avoidance function avQ. to the non-directional gradiant signal ndg(x). The math- 
ematical result is described by the equation: 

a(x) = av( ndg(x) ). 

to The artifact avoidance function is most efficiently implemented as a look-up-table (LUT). 
[0021] A generalized linear spatial filter is described by the equation 

t5 where the x^^p values represent local pixel values surrounding the ij*^ fMxel and the c^n values represent numerical coef- 
ficients that do not depend on the pixel values x^^n. A non-linear spatial filter herein described shall be defined as a spa- 
tial filter which can not be described by the linear spatial filter equation. The output of applying a generalized control 
signal to an input signal bears a multiplicative relationship to the input signal. An example of applying a control signal is 
given by the equation: 

JO 

y ,j = a ,j X IJ 

where the Xjj values represent the input signal ij*^ pixel values and the a, values represent the ij*^ pixel values of the con- 
trol signal. The result of applying a control signal to an input signal falls into the general category of a non-linear spatial 
t5 filter if the control signal is derived from a spatial filtered version of the input signal. The avoidance signal a{x) is an 
exanple of a control signal created from a spatially filtered version of the digital image channel. The texture signal q(x) 
described in the preferred embodiment is an example of a non-linear spatial filter produced with the application of a con- 
trol signal to the high-pass signal. 



4 



CID: <EP 0971314A2_I_> 




EP0 971 314 A2 



[0022] Referring to Rg. e/there is Olustrated an alternative configuration of the present invention. In this configuration, 
the cfigital image signal is passed through a frequency splitter 70, creating a tow-pass signal ard a high-pass signal 
from the original digital image channel. In this regard, the low-pass signal is then passed through a tone scale applicator 
30- The high-pass signal is then added to the tone scaled low-pass signal with an adder 50. 

5 [0023] Again refenring to Fig. 6. there is also illustrated that the digital image signal is passed through a tone scale 
applicator 30. The signal output of this tone scale applicator 30 is applied to the (1-a(x)) input of the avoidance adder 
130. to be descn'bed in detail below, to the sum resulting from the adder 50. which is applied to the (a(x)) input of the 
avoidance adder 130. After all of the image pixels have been processed in this manner, the array of pixels represented 
by the output of the avoidance adder 130 is a digitat image channel with an adjusted tone scale retaining the original 

10 sharpness of the original Image with nrdnimat artifacts. This output image channel, when rendered to an output device 
by any method well known in the art. is visually similar to the output of the preferred emtxxfiment. 
[0024] An avoidance adder 130 requires three inputs: 2 signals to be summed, and the artifact avoidance signal (a(x}). 
The two signals to be summed undergo a transformation such that one of the signals to be summed is multiplied by 
(a(x)), and the other is multiplied by (1-a(x)). The two transformed signals are then added. The signal input which is 

15 scaled by (a(x)) is known as the "(a(x)) input" of the avoidance adder 130 and the signal input which is scaled by (1- 
a(x)) is known as the "(1-a(x))" input of the avddance adder 130. If SI and S2 are the signals to be summed with an 
avoidance adder 130, the result of which is A, the foregoing may be reduced to an algebraic expression: 

A=(a(x))(S1) + (1-a(x))(S2) 

20 

Mathematics: 

[0025] The final processed pixel of the preferred embodiment may also be represented in functional form: 

25 t(x) =[x - [g(x) + a(x) h(x)D + f ( g(x) + a(x) h(x)) (1) 

Where: 

x = the input image channel 
30 t{x) = transformed digital iniage channel 
g(x) = a low-pass filtered version of x 
h(x) = a high-pass filtered version of x i.e. h(x) = x - g(x) 

fO = a tone scale function applied to either a digital image channel or image signal 
a(x) = the artifact avoidance signal (the control signal) 

35 

[0026] The artifact avoidance signal a(x) Is 1 for pixels in regions of the image which are generally flat (i.e. regions of 
the image where U.S. patent No. 5,012,333 does not produce artifacts.) The signal a(x) becomes 0 for pixels in regions 
of the image that contain high transition edges (i.e. regions of the image where U.S. patent No. 5,01 2,333 produces arti- 
facts.) The signal a(x) may take on any value within the range of 0.0 to 1.0 depending upon the structure of the local 
40 region of the image. 

[0027] At this point, it becomes useful to make several approximattons. The first is that with the nearly linear tone scale 
functions which are common to image processing. 

g(f(x))=f(g(x)). (2) 

45 

approximately. 

Secondly, in the case where a tone scale f(x) is applied to a signal x, the result is approximately: 

f(x)=f(g(x)) + f(g(x))*(h(x)) (3) 

50 

Because of the nearly linear (slowly varying second derivative) nature of most tone scales, the application of a tone 
scale to an image signal is nearly equivalent to applying the tone scale to the low-pass of the original image channel, 
and scaling the high-pass of the original image channel by the slope of the tone scale function, evaluated at low-pass 
of the original image channel. 
55 [0028] The third approximation follows directly from the first and second approximations. 

f(g(x))*(h(x)) = h(f(x)) (4) 
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[0029] Thus, if the equation summarizing the preferred embcxJiment is evaluated with the three approximations, the 
resulting approximation for the output pixel value in relatively flat regions (a(x) = 1) becomes: 

t(x) = f(g{x)) + h(x) 

5 

This result implies that in relatively flat regions of the image, the detail signal of the processed pixel is equal to the detail 
signal of the original (h(x)), but the contrast of the lowiDass signal has been modified by f(x). Likewise, when the equa- 
tion is simplified with the assumption that the pixel to be processed is near a high transition edge (a(x)=0), 

10 t(x) = f{x) 

This result implies that the processed version of the original pixels is only a function of the original pixel values and the 
tone scale function In regions near high transition edges. This result prevents the occunrence of artifacts at the edge 
regions. 

15 [0030] For pixels with an intermediate value of a(x), (0 < a(x) <1), the processed pixel will be bounded by f(x) and 
f(g(x)) + h(x). 

[0031] In summary, the method of the current invention allows a tone scale function to be applied to an image in such 
a way that the detail from the original image is preserved, except in those regions where preservation of the detail would 
produce unnatural artifacts. In these regions, the tone scale function is applied to the original pixel to produce the final 
20 output pixel. 

[0032] Many other flow diagrams may be constructed which will produce a result that, when evaluated with the three 
approximations, will be: 

t(x) = f{g(x)) + h(x) fbr(a(x) = 1) 

25 

t(x) = 1(x) for (a(x) = 0) 

These alternative flow diagrams may appear quite different from the one described by the preferred embodiment, but 
utilize the same components of an avoidance signal, frequency decomposition by spatial filtering, and a tone scale func- 
30 tion. The images processed with these various methods often contain small numerical differences (because of the 
approximations), txjt produce results that are visually comparable. 

[0033] For exanple, the alternative embodiment shown in Fig. 6 may be written algebraically from the flow diagram 
as: 

35 t(x) = (1-a(x))f(x)+a(x)[f(g(x)+h(x))] 

This equation may be evaluated with a(x) = 1 .0 (i.e. flat regions of the digital image channel ) and with a(x) = 0 (i.e. edge 
regions of the image) by the three approximations (equations (2), (3), and (4)) to yield: 

40 t(x) = f(g(x)) + h(x) for{a(x) = l) 

t(x) = f(x) for(a(x) = 0) 

Thus, the alternative embodiment of the present invention is similar (within the limits of the mathematical approxima- 
45 tions) to the preferred embodiment. 

[0034] The invention has been descrtoed with reference to a preferred embodiment However, it will be appreciated 
that variations and modifications can be effected by a person ordinary skill in the art writhout departing from the scope 
of the invention. 

so Claims 

1. A method for preserving detail when adjusting tone scale of a digital image channel, the method comprising: 

(a) receiving a digital image channel; 
55 (b) providing a tone scale function for adjusting the tone scale of the digital image channel; 

(d) using the tone scale function, artd the control signal to produce an enhanced digital image channel. 

2. The method as in claim 1 further comprising creating the control signal from a spatially filtered version of the digital 



6 



EP 0 971 314 A2 



image channel. 

3. The method as in daim 2» wherein step (a) includes generating a high pass and low pass signal; wherein stqa (b) 
includes generating at least two non-linear spatial filtered versions of the digital image channel from the high pass 

5 signal, the low pass signal, the control signal, ard the original digital image channel. 

4. The method as in daim 3, wherein step (a) Includes generating an enhanced digital image channel by application 
of the tone scale function to one of the non-linear spatial filtered versions of the digital image channel, and wherein 
step (b) includes adding the remaining non-linear spatial filtered versions. 

10 

5. The method as in daim 3, wherein step (a) includes generating an enharrced digital image channel by application 
of the tone scale function to one of the non-linear spatial filtered signal versions of the digital image channel, and 
wherein st^ (b) includes modifying tfie remaining non-linear spatial filtered signals, and wherein step (c) indudes 
adding the modifying the non-linear spatial filtered signals. 

15 

6. The method of claim 1, wherein step (a) indudes receiving a luminance channel as the digital image channel. 

7. The method of claim 1 . wherein step (a) indudes receiving either a red, green and blue channel as the digital image 
channel. 

20 

8. The method as in claim 7, wherein steps (b) — (d) are performed on each of the red, green and kslue color channels. 
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(57) A nnethod for preserving detail when adjusting 
tone scale of a digital image channel, the method com- 
prises receiving a digital image channel; providing a 
tone scale function for adjusting the tone scale of the 
digital image channel; spatial filtering the digital image 
with a spatial fitter which varies with location in the dig- 
ital image channel according to the control signal pro- 
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